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continuous time intertemporal decision optimization problem with non- 
constant discounting. The equilibrium equation takes two different forms, 
one of which is reminescent of the classical Hamilton- Jacobi-Bellman equa- 
tion of optimal control, but with a non-local term. We give a local 
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1 Introduction 

This paper adresses the problem of time inconsistency under non-constant dis- 
counting. Whereas our method and result are quite general in character, we 
have chosen to illustrate them in the framework of the Ramsey model of eco- 
nomic growth, (1928; see for instance [SI), which has also been used as a test 
case by Barro 5 and Karp 18 in their investigations of the subject. 

In its typical formulation, the Ramsey model represents the decision maker 
as maximizing: 

max/ h(t)u{c{t))dt + h{T)g{k{T)) (1) 

^^f{t,k{t))~c{t), fc(0) = fco (2) 

where [0, T] is the life span of the decision maker and where the function / maps 
[0, T] X R'^ onto R'^. Here, the decision maker can be interpreted either as an 
individual or as a governement. In either case, c denotes the consumption of 
the representative individual, u (c (t)) is the utility of current consumption, k (i) 
is current capital and g{k{T)) is the utility of terminal capital. If the decision 
maker is an individual, f{t,k{t)) represents capital rental interest and wages, 
and if it is a government, it represents production and capital depreciation. 

h : [0, oo] — > i? is the discount function. Here and in the sequel, it will 
be assumed that it is continuously differentiable, with h{0) = 1, h{t) > 0, 
h' (t) < and h{t) — > when t — > oo. The classical case, the one considered 
by Ramsey and the subsequent litterature until the pionneering work of Strotz 
1221, is the one when the discount rate is constant: h (i) = exp {~pt) . 

The decision maker, be it an individual or a government, faces this maxi- 
mization problem at time 0, and decides on an overall solution, t —^ (c (i) , a; (t)), 
valid for < t < T. At any intermediate time t, the decision-maker, either her- 
self at a later time if she is an individual, or whoever is in office if it is a 
governement, will face a similar problem, namely: 

max / h{t-s)u{c (s)) ds + h{T-t)g (k (T)) 

dk 

— = /(s,fc(s))-c(s), s>t, kit)^kt 

as 

where kt is the existing capital at time t. The solution to this problem will 
be some s — > {c{s) ,x(s)), valid for t < s < T. If this is different from s — > 
{c{s) ,x{s)), then the decision-maker at time t is being asked to implement a 
policy which, from her point of view is suboptimal. This she will not do, unless 
the decision-maker at time has found a way to commit her. If this is not 
the case, then the optimal policy i — > {c{t) ,x (t)) for problem ^ Q cannot be 
implemented. This is the problem of time-inconsistency, which has been studied 
by many authors: see ^^1 for a survey. 



It has been known for a long time that in the case where the discount rate 
is constant, so that h{t) = exp(— pi), time consistency obtains: (c, x) = {c,x), 
so that the decision-maker at time can count on the decision-makers at all 
intermediate times to implement the decisions she has planned. The funda- 
mental reason for which time consistency obtains is that preference reversals 
due to the mere passage of time are precluded: with a constant discount rate, 
relative preference between two prospective consumption plans is unaffected by 
their distance into the future^. In other words, when the discount function is 
exponential, relative preferences induced from the discounted utility model do 
not change with time. 

But why should the discount function be precisely exponential ? Experimen- 
tal evidence from psychology challenges the main consequences to be derived 
from constant discount rates: see Ainslie [5] and Frederick et al ^31 for an 
overview. Relative preferences do seem to change with time. In particular, 
there is robust evidence of an inclination for imminent gratification even if ac- 
companied by harmful delayed consequences. This suggest a discount rate which 
is declining over time (see Ainslie ^ and Lowenstein and Prelec [22 )■ In other 
words, the discount function h should be hyperbolic, that is, h'/h should be 
decreasing. 

In this paper, we will deal with general discount functions: they need not 
be hyperbolic, but they are certainly not exponential. Then time-inconsistency 
obtains. We shall also assume that the decision-maker at time cannot commit 
the decision- makers at later times t > 0. This means that the solution of 
problem |^, ^ cannot be implemented. In other words, there is no way for 
the decision-maker at time to achieve what is, from her point of view, the 
optimal solution of the problem, and she must turn to a second-best policy. 
Defining and studying such a policy is the first aim of this paper. The path to 
follow is clear. The best the decision-maker at time t can do is to guess what her 
successors are planning to do, and to plan her own consumption c (t) accordingly. 
In other words, we will be looking for a subgame-perfect equilibrium of a certain 
game. 

A second idea now comes into play: we will assume that none of the decision- 
makers is sufficiently powerful to influence the global outcome. This is very 
similar to perfect competition, where no agent is sufficiently important to affect 
prices, and it will be formalized in the same way. In his seminal paper ^, 
Aumann captures that idea by considering an exchange economy where the set 
of traders is the interval [0, 1]. An allocation then is a map x : [0, 1] -^ i?" 

^To see this, assume 0<r<s<t<T and consider two consumption plans c{v) and c{v) 
valid for v > t. The incremental utilities (/(/)for self "r" and self "s" are related by 

IUr.= f £-''(''-'■' [U ic(v)) - U {c(v))] dv 

i-T 

= e-P(^-r) / e""'"-'' [u {c{v)) - u {c{v))] dv =: e-^^'^'hUs 

and therefore the ordinal ranking of c and c does not change with the mere passage of time. 



and the total consumption of a coalition A C [0, 1] is the integral: 

X (t) dt 



A 

so that individuals, and more generally coalitions with vanishing Lebesgue mea- 
sure, have zero consumption, and therefore cannot influence prices. However, 
a small coalition [i, t + e] will be able to do so, and its weight will be roughly 
proportional to e. 

Similarly, we will consider that the set of decision-makers is the interval 
[0, T]. At time i, there is a decision- maker who decides what current consump- 
tion c (i) shall be. As is readily seen from the equation ((SJ, changing the value of 
c at just one point in time will not affect the trajectory. However, the decision- 
maker at time t is allowed to form a coalition with her immediate successors, 
that is with all s S [t, i + e], and we will derive the definition of an equilibrium 
strategy by letting e — » 0. In fact, we are assuming that the decision-maker 
t can commit her immediate successors (but not, as we said before, her more 
distant ones), but that the commitment span is vanishingly small. 

In section |21 we use that idea to derive a suitable concept of equilibrium 
strategy. Given a strategy c = cr(i, fc), a coalition [t, i 4- e] will be able to 
perturb the discounted utility at time t by deviating unilaterally, that is, by 
choosing some c (t) different from a (i, k (t)); the perturbation will of course be 
of the first order in e. If there is no incentive for this coalition to deviate, in the 
sense that this perturbation is always non-positive, and zero if and only if c (i) = 
a (t,k (t)), then a is an e-equilibrium, in fact a subgame perfect equilibrium. 
Letting e — > 0, we derive an appropriate notion of equilibrium strategy in the 
case when individual decision makers do not have market power. 

In section |21 we characterize the newly defined equilibrium strategies in 
terms of a value function V (t, k). This function is seen to satisfy two equivalent 
equations, (IE) and (DE), the latter being very similar to the usual Hamilton- 
Jacobi-Bellman (HJB) equation of optimal control, and reducing to (HJB) in the 
case when h (t) is an exponential. However, (DE) is not a partial differential 
equation: it contains a non-local term, which makes it much more difficult 
to study than a straightforward partial differential equation. We have only a 
local existence result, which is stated without proof. However, in section^ we 
provide explicit examples in the case when the horizon is infinite, T = cx), and 
/ (i, k) takes the special form r{t)k-\-w {t) (capital revenue plus wage). We also 
investigate the naive strategy, where each decision-maker simply forgets that he 
cannot commit his successors, and plays as if she could; we show that it is not 
an equilibrium strategy, unless u (c) = In c. 

In section we focus on the infinite- horizon problem, with n = 1, and we 
investigate whether there is some k such that all paths k (i) converge to k in 
equilibrium. This is the question of balanced growth, which has been much 
studied in the case when h (t) — exp {—pt), and optimal control theory applies; 
it is well known that in that case, we must have /' (k) = r, which effectively pins 
down the value of k. In the case of general discount function, we find that /' (fc) 



must belong to some interval, and that, ceteris paribus, this interval converges 
to the point r ii h (t) converges to exp {—pt). We conclude in section|Hl 

The results obtained in sections |S1 and El are very similar to those obtained 
earlier by Barro [S] and by Karp |18| . The main contribution of the present 
paper lies elsewhere, in the precise definition of equilibrium strategies, and in 
their characterization through a value function V {t, k) which has to satisfy 
certain equations, reminescent of the (HJB) equation. This allows us to carry 
the calculations somewhat further than Barro or Karp, and it also opens the 
door to a systematic study of the problem. The local existence result which 
we give is an example of what can be obtained through our approach, and not 
otherwise. 

The case when time is discrete, ti — 0,t2, ...,t„_i,i„ = T, has been investi- 
gated by many authors, for instance Strotz |22] , Pollak [211, Peleg and Yaari 
fI7\ . Phelps and Pollak [2H|, and more recently, Laibson [211]. The last decision- 
maker operates at time tn-i; after he has acted, the party is over. He is facing 
a plain vanilla optimization problem, and solves it. His predecessor operates 
at time t„_2- She is faced with a leader- follower game, which she solves by 
integrating the strategy of her successor into her own decision. In principle, by 
proceeding recursively in this way, one can go all the way back to ti = 0, the 
very first decision to be made (which, again, would not be the optimal one from 
the time perspective, if this particular decision-maker could commit all her 
successors). If this method is successful, it yields a subgame perfect equilibrium, 
and the corresponding policy will follow through despite the lack of commitment 
devices. It is also important to observe that the equilibrium policy, as in the 
prisoner's dilemma game, is suboptimal relative to the outcome that can occur 
with a pre-commitment technology. Using this approach (and extending it), a 
recent literature has flourished showing that apparent irrationality of individu- 
als, even in financial markets, can be ascribed to the fact that the psychological 
discount factor is not exponential; see Laibson [21], O'Donoghue and Rabin 
|26|. Harris and Laibson ^3|, Krusell and Smith ^^, Diamond and Koszegi 
|12|. Luttmcr and Mariotti "^ and others. 

Unfortunately, such games typically fail to have a subgame-perfect equilib- 
rium. The reason is that, even if u is concave with respect to c, the payoff to the 
decision-maker at time ti is not concave with respect to his own consumption Ci , 
because Ci determines the capital fci+i at time ii+i, and constrains the choice of 
the next decision-maker in a complicated, and certainly non-linear, way. Pro- 
ceeding recursively from i„_i, the strategy a = at (ki) at time ti will end up 
being discontinuous with respect to fc^, which effectively kills the hope of find- 
ing a subgame-perfect equilibrium. It is a fundamental difficulty of the discrete 
time model, and various ways have been devised to get around this problem, 
such as adding a public correlation device, as in Harris, Reny and Robson |3l)| 
(see also |SI)- With this in mind, it comes as no surprise that existence results 
for subgame-perfect equilibria in continuous time arc so hard to prove. 



2 Equilibrium strategies: definition 

We consider an intertemporal decision problem where the decision-maker at 
time t is striving to maximise: 

T 

h{s~t)u{c (s)) ds + h{T -t)g{k (T)) (3) 

Jt 

subject to: 

dk 

- = f{s,k{s))-c{s), k{t)^h. (4) 

Notations are as stated in the introduction. Recall that h is continuously 
differentiable, with h (0) = 1, ft, (i) > 0, h' [t) < 0, and h(t) ^0 when t -^ cx). 
It will also be assumed that u, /, g are twice continuously differentiable, that u 
is strictly concave, and that / is strictly concave with respect to k. 

We shall denote by i : R"^ ^ R'^ the inverse of the derivative u' : R''' ^ R'^ : 

u' (c) = X ■<=> c — i{x) 

and it will be assumed that it is continuously differentiable. We shall also 
consider the Legendre-Fenchel transform u of the concave function u, defined 
by: 

u{x) — max (u(c) -- xc) — u[i ix)) — xi (x) 

Note that it is a convex function. By the envelope theorem, we have: 

u' {x) = —i (x) = [—u'] {x) 

We now proceed to define subgame-perfect equilibrium strategies, using the 
approach outlined in the introduction. A strategy c = cr (i, k) has been an- 
nounced an is public knowledge. All decision-makers up to time t have applied 
this strategy, that is, the dynamics of capital between times and t are given 

by: 

dk 

— ^fis,k)~ais,k), kiO)^ko (5) 
as 

The decision- maker at time t inherits a capital kt , which is the value at s = i 
of the solution to the Cauchy problem Q. She can commit all the decision- 
makers in [t, t + e] , where e > is vanishingly small. She expects all later ones 
to apply the strategy a : [0,T] x i?'' — > R'^, and she asks herself if it is in her 
own interest to apply the same strategy, that is, to consume a{t,k). If she 
consumes another bundle, c say, the immediate utility flow during [i, i -f e] is 
u (c) £. At time t + e, the resulting capital will he k + {f {t, k) — c) e, and from 
then on, the strategy a will be applied. The consumption at time s > t + r is 
c{s) = a (s, k (s)) , where 

dk 

-^f{s,k{s))~a{s,k{s)), s>t + e (6) 

k{t + e) = kt + if (t, kt) -c)e (7) 



Denote by fco (s) the future path of capital if the decision-maker at time t 
apphcs the strategy ct, that is, if c = ct (t, kt). The dynamic of ko is given by: 

^ = f{s,ko{s))-a{s,ko{s)), s>t (8) 

fco (t) - kt (9) 

Write k (s) = fco (s) + fci (s) e, plug that into ©,1(711, keeping only terms of 
first order in e. We get: 

(XKQ U,rZ\ / \\ ^J / 7/\\T/\ / T/\\ 

— - + e— - = / (s, fco (s)) + e-— (s, fco (s)) fci (s) - ct (s, fco (s)) 

- e-^ (s, fco (s)) fci (s) , s>t + e, 
k{t + e) = ko{t + e)+ efci (t + e) 

= fco (i) + e—^ {t) + efci (t + e) 
as 

= fct + e (/ (s, kt) - CT (t, fct)) + efci (i + e) 

where -^ and ^ stand for the matrix of partial derivatives of / and ct with 
respect to fc e R . Comparing with (|Sl),ljnjl and iQ, we get the linear differential 
system: 

dfci fdf, , , ,. da , , . sA , , ^ 

~d^ ^ \'dk^^ ° ^'' ~ afc ^*' ^'^-'^ ) ^1 (*) ' s>t + e 

fci (i + e) = CT (i, fct) — c 

Summing up, we find that the total gain for the decision-maker at time t from 
consuming bundle c during the interval of length s when she can commit, is: 

u{c)s+ f h{s-t)u{a (s, fco (s) + efci (s))) ds + h{T-t) {g (fco (T) + efci (T))) 

i-T 

h{s~t)u{a (s, fco (s))) ds + h{T -t)g (fco (T)) 



T 



9u , , . , ,,, 9ct 



u{c)-u {a{t, k))+ I h{s~t) — (ct (s, fco (s))) ^ (s, fco (s)) fci (s) ds 



+ h{T-t)^{k,{T))k,{T) 



h.o.t 



where 4| (resp. ^) is the vector of partial derivatives of g (resp. u) with 
respect to fc £ i?'' (resp. c G i?*^) and h.o.t denotes higher-order terms in e. 

In the limit, when e — » 0, and the commitment span of the decision- maker 
vanishes, we are left with two terms only. Note that the first term does not 
depend on the decision taken at time t, but the second one does. This is the one 
that the decision-maker at time t will try to maximize. In other words, given 



that a strategy a has been announced and that the current state is kt ^ k , the 
decision-maker at time t faces the optimisation problem: 

max Pi {t, k, (J, c) (10) 

c 

where: 

Pi (t, fc, a,c) — u (c) — u {a{t, k)) 

h{s~t) — {(j (s, /co (s))) -qT (s, fco (s)) fci (s) ds 

+ /»(r-i)||(fco(r))fci(T), 

In the above expression, fco (s) and fci (s) are given by: 

— = / (s, /co (s)) - cr (s, /co (s)) 
fco (i) = k 



fci (i) = cr (i, fc) - C (12) 

Definition 1 We shall say that a : [0, T] x R"^ ^ W^ is an equilibrium strat- 
egy for the intertemporal decision model ^,^ if, for every t G [0,T] 
and k £ R'^ , the maximum in problem i|JO|) is attained for c — a {t, k): 

<T (i, k) — argmaxPi [t, fc, a^ c) 

c 

The intuition behind this definition is quite simple. Each decision-maker 
can commit only for a small time e, so he can only hope to exert a very small 
influence on the final result. In fact, if the decision-maker at time t plays c when 
he/she is called to bat, while all the others are applying the strategy a, the end 
payoff for him/her will be of the form 

Pq {t, fc, a) + ePi {t, k, cr, c) 

where the first term of the right hand side does not depend on c. In the absence 
of commitment, the decision-maker at time t will choose whichever c maximizes 
the second term sPi (i, k, a, c). Saying that a is an equilibrium strategy means 
that the decision maker at time t will choose c = a{t,k), that is, that the 
strategy a can be implemented even in the absence of commitment. 

Conversely, is a strategy a for the intertemporal decision model Q,® is 
not an equilibrium strategy, then it cannot be implemented unless the decision- 
maker at time has some way to commit his successors. Typically, an optimal 
strategy will not be an equilibrium strategy. More precisely, a strategy which 



appears to be optimal at time no longer appears to be optimal at times t > 0, 
which means that the decision-maker at time t feels he can do better than 
whatever was planned for him to do at time 0. In the case of macroeconomic 
policy, for instance, successive governments will disagree on what is an optimal 
strategy, even if they agree on the collective utility u (c) , so that the concept of 
equilibrium strategy seems far more reasonable - at least it stands a chance of 
being implemented. 

What happens then if successive decision-makers take the myopic view, and 
each of them acts as if he could commit his successors ? At time t, then, the 
decision-maker would maximise the integral Q with the usual tools of control 
theory, thereby deriving a consumption c = an {t, k). This is the naive strategy; 
in general it will not be an equilibrium strategy, so that every decison-maker 
has an incentive to deviate. It will be studied in more detail in sectional 

3 Characterization and existence of equilibrium 
strategies 

In this section, we characterize equilibrium strategies of problem (??), (??), 
(pj)l. by an equation, which we call the equilibrium equation (E), and which is 
reminescent - although different from - of the Hamilton-Jacobi-Bellman (HJB) 
equation of optimal control. Note that there is also an (HJB) equation associ- 
ated with problem Q),©, but it is different from the equilibrium equation, and 
characterizes optimal strategies instead of equilibrium ones. We will see that 
the only case when equations (E) and (HJB) coincide is the case of exponential 
discount, and then equilibrium strategies are also optimal strategies. 

The equilibrium equation comes in two different guises: an integrated form 
(IE) and a differentiated form (DE). We first derive the integrated form, and 
then we show that it is equivalent to the differentiated one. Finally, under 
suitable technical conditions on the utility function u and the function /, we 
show that solutions to the equilibrium equation exist close to the terminal time 
T. 

Given a strategy a (i, fc), we shall be dealing with the differential equation: 

^=J{s,k{s))^a{s,k{s)) (13) 

fc (i) = fc 

We shall denote by IC {s,t, k) the flow associated with this equation, that is 
the value at time s of the solution of 113|l which takes the value k at time t. It 
is defined by: 



dK.(s,t,k) 



f{s,JCis,t,k))-ais,IC{s,t,k)) (14) 



ds 
IC(t,t,k) = k. (15) 



In other words, /C (s, t, k) is the value at thiie s of the solution of: 

^ = f{s,k)-a{s,k) (16) 

which takes the value k at time t. 

3.1 Equilibrium characterization 

We shall say that a function V : [0,T] x R"^ —^ R satisfies the integrated equilib- 
rium equation (IE) if we have, for every t G [0, T] and every k : 

V{t,k) = j h{s-t)uoif^{s,ko{s)))ds + h{T~t)g{ko{T)) ((IE)) 

where: 

-^ = / (s, fco (s)) - i o — (s, fco(s)) 

fco (i) = /c 

Note that every solution of (IE) must satisfy the boundary condition: 

V (T, k) = g (k) Vfc (BC) 

The following theorem characterizes the equilibrium strategies and its proof 
is given in the Appendix A. 

Theorem 2 Let a : [0, T] x R -^ R be jointly continuous, and continously 
differentiate with respect to k and let K, be the associated flow defined by \14^ , 
(??J. Suppose a is an equilibrium strategy for the intertemporal decision model 
|3),CT- Then the function: 

V{t,k)^ I h{s~t)u{a{s,K:{s,t,k)))ds + h{T-t)g{}C{T,t,k)), (17) 

satisfies the integrated equilibrium equation (IE) and we have: 

|^W^,fc)) = |^(^:fc) (18) 

Conversely, if a function V is twice continuously dijjerentiable and satisfies the 
integrated equilibrium equation (IE), then: 

a{t,k)=i[^{t,k) 

is an equilibrium strategy. 
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Relation (|18|) says that, along an equilibrium path, the effect of an increment 
to current wealth on future utility, ^ {t, k) , must balance the effect of an incre- 
ment to current consumption on current utility,^ (cr(t, k)). Thus, relation lfTH|l 
reflects the usual tradeoff between utility derived from current consumption and 
utility value of saving. 

From now on, we rewrite (IE) in the form 

V{t,k)= I h{s-t)u{(T{s,K:{s,t,k)))ds + h{T~t)g{}C{T,t,k)), (19) 



with the understanding that /C (s, t, k) is the flow associated with a {t, k) = 
^-^it,k). 

The following proposition gives a differentiated version of the equilibrium 
equation. 

Proposition 3 Assume that a function V (t, k) is twice continuously differen- 
tiahle. Then V satisfies the integrated equilibrium equation (IE) if and only if 
it satisfies the differentiated equilibrium equation: 

^(t,fc)+ j h'{s~t)u{a{s,IC{s,t,k)))ds + h'{T-t)g{K:{T,t,k)) 

fdV \ dV 
+ ui^—{t,k)j+—{t,k)f{t,k)^0, (DE) 

for all {t, k) £ [0, T] x R"^, with the boundary condition 

V{T,k)^g{k). (BC) 

Appendix B proves this proposition. It may be useful to rewrite it in the 
following way: 

Pit, ^) - ^ (" (^(i' k)) + ^(t, k) + ^{t, k)^{t, t, k)^ (20) 

where: 

^ I^ ^^K^ - t)u (a(s, JC is, t, k))) ds + 0Eg^(r - t)g jJC (T, t, k)) 

/f h{s - t)u (cr(s, fC (s, t, k))) ds + h{T - t)g {K, (T, t, k)) 

is interpreted as an effective discount rate. Equation (|2()|l then tells us that, 
along an equilibrium path, the relative changes in value to the consumer must 
be equal to the effective discount rate. 

Finally, when the discount rate is exponential, the effective discount rate 
is just the constant discount rate p = ~h'{t)/h{t) and equation (DE) becomes 
simply the familiar (HJB) equation. 

Corollary 4 With the exponential discounting h(s) — e^''", the (DE) equation 
reduces to: 

dV fdV \ dV 

— it, k) ~ pV{t, k) + u(—{t, k))] + — (i, k)f{t, k) = (21) 
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Proof. In the exponential case, equations (IE) and (DE) become: 

V{t, k) = / e-^("-*)u (a(s, K. (s, t, k))) ds + e~P^'^~''>g (/C (T, t, k)) , 



^{t,k)~pj e-P^'-'^u{a{s,IC{s,t,k)))ds - pe-P^^-'^g{JC{T,t,k)) 
( dV \ dV 

+ ^[-gj:it^k))j+—{t,k)f{t,k)^o. 

Comparing, we immediately get (|^ . ■ 

3.2 Existence 

Neither equation (IE) nor equation (DE) are of a classical mathematical type. 
If it were not for the integral term, equation (DE) would be a first-order partial 
differential equation of known type (Hamilton- Jacobi), but this additional term 
(an integral along the trajectory of the flow l|14() associated with the solution 
V (t, k) creates additional complications. 

In the sequel, we will solve that equation explicitly in particular cases. The 
questions of existence and uniqueness in the general case are very much open. 
In forhconiing work, Ekeland and Nirenberg prove a local existence result: 

Theorem 5 Assume that all data (u, /, g and h) are analytic Junctions. Then, 
for every k, there are numbers e > 0, ry > and a function V {t, k), defined for 
T — e < t < T and fc — fc < 77, such that V satisfies (DE) and (BC) 

Recall that a function is analytic at a given point if its Taylor expansion at 
that point has a non-zero radius of convergence. It is analytic if it is analytic 
at every point. The proof of the theorem relies on a generalized version of the 
classical Cauchy-Kowalewska theorem due to Nishida and Nirenberg [21] . 

3.3 The infinite-horizon problem 

In the sequel, we will be looking at the infinite-horizon problem, whereby the 
benefit to the decision-maker at time i of a future consumption path s — > 

c{s) ,s >t, is: 

h{s — t)u{c (s)) ds 
The change of variables s' = s — t >0 brings that integral to the form: 

h{s')u{c{s' + t))ds' 


which is the benefit which the decision-maker at time derives from a future 
consumption path s' —> c (s' + t). 
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Assume now that the problem is stationary, meaning that the production 
function / (t, k) does not depend on t : 

f {t, k) = f (fc) 

In that case, if the decision-maker at time t resets his watch, so that time 
s becomes s — t, she faces exactly the same problem as the decision-maker at 
time 0. Under these circumstances, it is natural to expect that, if both decision- 
makers have the same capital fc, they will get the same equilibrium value: 

V{t,k)^V{k) Vfc 

We will now look directly for time-independent value functions. Consider 
the equations: 

V{k) = j h{t)uUo — {JC{t,Q,k))\dt (22) 

dV f°° fdV \ fdV \ 

= |^(fc)/(fc)-fy^ h'{t)uoi[^{lC{t,Q,k)yt + u(^{k))^ (23) 

Lemma 6 If aC^ function V {k) satisfies equation 1^2^) or 1^2'diil . then V {t, k) := 
V (k) is a value function for the infinite-horizon problem. 

Proof. It is enough to show it for equation 122|l . We have to prove that, for 
every t, we have: 

f°° f dV \ 

V{k)= h{s-t)uiio — {JC{s-t,t,k))\ ds 

Note that the differential equation H14|l becomes autonomous, and the function 
/C displays the additional property 

K. (s, ti,k) — IC{s — t2,ti —t2,k) , < t2 < ti < s. 



Changing variables in the integral, we get: 

V{k)^ h{s)uiio — {IC {s, 0, k)) J ds 

which is precisely equation (|22() . ■ 

If V (fc) satisfies (|22() or (|23|l . the corresponding equilibrium strategy: 

dV 

<r{k)=^o — 

which is time- independent, will be called stationary. Note that a stationary 
problem may have non-stationary equilibria. 
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4 The consumption-saving problem 

In this section, we assume d = 1, so that there is only one good, and we wiU be 
looking at a special case of the infinite-horizon problem. At any point in time 
s G [0, oo) the consumer has a stock of wealth fc(s) G (0, cxj) and receives a flow 
of labor income w{s) as well as a flow of interest income r(s)k{s). Beginning 
with a capital stock k G (0, cx)) at time t, we formulate the consumption-saving 
problem by 

/•oo 

max / h {s - t) u {c (s)) ds (24) 

w{s)+r{s)k{s)~c{s), k{t)^kt. (25) 



It 
dk{s) 



ds 

This is a special case of the general problem ©, Q, with: 

/ (i, k) := w{t)+r (t) k 

We emphasize that at any point in time t G [0, cx)) the consumer takes as 
given the interest rate r{t) and the wage w(t). Since r (t) and w (t) are time- 
dependent, we expect the value function to be non-stationary, even though the 
horizon is infinite. 

Equation (IE) becomes 

V{t,k)^ f h{s-t)uoif-^{s,K:{s,t,k)yjds (26) 



^,)IC(s,t,k)~to^{s,IC{s,t,k)) (27) 

(28) 

The next subsection gives explicit solutions when the utility function is in 
the CRRA class. 

4.1 CRRA preferences 

In this section, we shall assume that d = 1 and that the utility function takes 
one of the forms: 

u(c) = , 7 > 

1-7 

u (c) = In c 

the latter corresponding to 7 = l.An explicit construction of the equilibrium 
strategy will be shown to be possible under an additional assumption: 
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where the flow /C {i 


',t,k) 


solves 


dK{s,t, 
ds 


k) 


w{s) -{ 


ICit,t. 


,k) = 


k. 



Assumption A: There is at least one non-negative function i — > A (i) which 
solves the fixed-point problem: 



m 



X{sy-'' eyip 



(1-7) / (A(m) -r{u))du 



h{s — t)ds 



(29) 



Proposition 7 // the utility function is CRRA and A (t) is given by 1^29^ . the 
strategy 



ait, k) = \{t) 



k + I cxp 



— / r{u)du 



w{s)ds 



(30) 



is an equilibrium strategy for the infinite-horizon problem. The associated value 
function is given by 



V{t,k) = [X{t)]-^ 



[k + J^ exp [— J^ r{u)du] w{s)di 



,1-7 



The equilibrium policy (|30|l consists of consuming the proportion A (i) of 
current wealth; the latter is the sum of the current capital stock and the present 
value of future wages. 

The proof of Proposition [3 is given in Appendix ICl 

We now investigate equation (|29|l more closely. There are three cases where 
it can be solved easily: 

4.1.1 Constant discounting 

In the case when h{s) — e^''", we find that the fmiction 



m :- 



exp 



/■oo 
t exp 



no((l-7)K^)~p)rf^ 



Jo ii'^-lMu) - p)du 



1 fS 

7 



ds 



solves the equation 129|l provided that the above integrals are well-defined. 
Therefore, the pohcy 



ait.k) = A(t) 



/oc 
exp 



r{u)du 



w{s)ds 



(31) 



is an equilibrium policy. Note that this is precisely the optimal policy from 
the time t perspective, which was expected anyway, since, with exponential 
discount, optimal policies are equilibrium policies. 



4.1.2 Logarithmic utility 

We are now back with a general discount function h (t) , but we choose a partic- 
ular utility function, namely u (c) = In c, so that 7=1. The equation reduces 
to: 



m 



h{s — t)ds 



h (t) dt 
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So A is constant (in spite of the fact that the interest rate on capital r (t) is 
time-dependent). This fact was first observed by Barro [S]. The corresponding 
equilibrium strategy is: 



a{t,k) 



lo h{s)ds 



k + I exp 



'■{ujdu 



w{s)ds 



4.1.3 Knife-edge case 

Assume the interest rate on capital is constant and given by 

h{s)ds 
We seek to solve equation (|29ll for a constant A. This yields: 



(32) 



Al-7e-(l-7)(A-r)(.-t)/^(^_^)^^ 



\^-"'h{s-t)ds 



= x 



h[s)ds 



so that A = r. The corresponding equilibrium is given by: 



a{t, k) 



^r[s~t) 



w{s)ds 



Given that along this equilibrium path, the consumers will consume the 
annuity value of the wealth, the above equilibrium is consistent with Friedman's 
permanent-income model. Note that this equilibrium strategy would also be 
the optimal strategy for the case of a constant discount rate equal to r, so that 
h{s) = e-''". 

4.2 Constant interest rate 

In this subsection, we shall assume that the interest rate on capital is constant: 

r [t) — r 

The following examples provide, for some specific discount functions /i, ex- 
plicit formulas for some equilibrium strategies with constant propensity to con- 
sume out of wealth. 



4.2.1 Exponential discount 

When the discount function is exponential h{s) = e^''", the equation (|29|) for A 
takes the form 

/oo 
g-(p+(A-r)(l-^))(«-t)^^^ 
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where r > is the constant interest rate. If the above integral is well defined, 
we see that: 



\ = 


p-r 
r + ^ =:Ao. 

7 


r /-oo 1 


Ao 


k+ e-''("-*)w(s)ds 



The policy 

ait,k) = Ao 

is an equilibrium policy provided Aq > 0, that is p — r(f — 7) > 0. 

4.2.2 A mixture of exponential discount functions 

For convenience, assume that 7 > I. 

Consider the case when the discount function is the mixture of two expo- 
nential functions, that is: 

h{s) ^uje-P'' + {l-uj)e-P^% 

where < pi < P2, and uj e [0, 1]. The instantaneous discount rate associated 
to h at time t is 

h'{t) . . 1-OJ 

- Pi + iP2 - Pi)- 



h{t) ^' "^^ '^''u;e(p^-P^')^ + {l-uj) 

and is gradually declining from po := topi + (1 — uj)p2 (at time i = 0) to pi 
(at time t = 00). Therefore, this specification captures the idea that discount 
rates decline with the horizon over which utility is discounted, a feature that 
O'Donoghue an Rabin (HHI) HH]) call the "present bias". The mixture of expo- 
nential discount function also corresponds to what Harris and Laibson |16| call 
the " auxiliary model" . 

If the discount rate were constant and equal to the long term value pi , we 
would have a stationary equilibrium policy where A = r -I- (pi — r) /j.li the 
discount rate were constant and equal to the short term value po, we would 
have a stationary equilibrium policy where X = r + (po — r) /j. Each of them 
would be optimal in its own context, given that the discount rate is constant. 

In the general case where ui e (0, 1), so that the discount rate declines from 
Po to pi, we look for an equilibrium policy where the propensity to consume 
out of wealth is a constant A. After integrating, equation H29|l turns out to be 
equivalent to the following: 

^^^^"pi + (A-"r)(l-7)+P2 + (A-rKl-7)"A=^' ^^^^ 

provided that the integrability conditions: 

p, + (A-r)(l-7)>0, i = l,2 (34) 

are satisfied. 
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The function / is increasing on the interval (0, r H — ^) and furthermore 
/(O) — — cx) and f{r H — ^) = +cx). Therefore there must exist a unique value 
Ai G (0,r + -^) such that /(Ai) = 0. RecaUing that 7 > 1, it is easy to see 
that Ai satisfies the integrability condition (|34|l and a further inspection reveals 
that Ai is the unique solution of the recursion H33|) satisfying the integrability 
condition H34|) . Therefore, Ai gives rise to an equilibrium strategy. 

Evaluating / at A gives 



/(A) = 7(1 - 7) 



Pi+7(P2-pi)-r-(l -7) pi-r(l-7) 



<0, 



and since / is increasing, we obtain that A < Ai. 
If the interest rate r has the precise value: 

1 



P2 



then Ai = r is the solution, and in that case A < Ai < A. 

4.2.3 Quasi hyperbolic discount. 

We define the discount function (in continuous time) as 

--P" for < s < T 



^^' \ Se'P" for s > T 

where r > and S G (0, 1]. 

When 6^1, the discount is exponential and the equilibrium is the one 
described in the preceding subsection assuming that p = p — r(l — 7) > 0. If 
(5 < 1, assuming a time invariant propensity to consume out of wealth, and 
integrating the equation if^ yields: 



1 



A 



p + A(l-7) 
or equivalently / (A) — 0, where: 



1 - (1 - 5)e-('^+^(i-''»^ 



/ (A) = 7 - (1 - 5)e-('^+^(i-T»^ - ^ 

A 

provided that an integrability condition holds: 

p + A(l-7)>0 (35) 

If < 7 < 1, we see that /' > and thus / is non decreasing. On the other 
hand, when /(A) -^ —00 when A ^ 0, A > 0, and /(A) -^ 7 when A — > 00 so that 
there must exist a unique A2 such that /(A2) = 0. Since 7 < 1, the integrability 
condition H35II is satisfied 
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If 7 > 1, we have / (A) -^ -cx) when A ^ 0, A > 0, and / [-j^) = S > 0, 
so that / has at least one root A2 satisfying the integrabihty condition. 

So the existence of an equihbriuni strategy with a constant propensity to 
consume A (t) = A2 is proved in aU cases. 

In the hniiting case when t -^ 0, whe obtain the instant gratification model 
of Harris and Laibson [TBj. Then: 

p + r(7- 1) 
+ 7 - 1 

which satisfies the integrabihty condition (|35|1 when 7 > 1. 

4.2.4 General hyperbolic discount function 

We consider the discount function 

/i(s) = we-P", a>0,/3>0 and p > 

specified by Luttmer and Mariotti 23 and which particularizes, when p = 0, 
the generalized hyperbolic discount function reported in Loewenstein and Prelec 
P^. The resulting discount rate: 

h'js) ^ ^ P 
h{s) I + as 

is smoothly declining from p + /? (at s = 0) to p (at s = 00). The coefficient 
a determines how close the discount function h is to the exponentials e^'"^ and 

g-(p+/3)s^ 

The equation H29|l becomes 



1 = A / ^^e-(^+(^-'-)(i-^))«ds 







(l + as)< 

provided the integrabihty condition p + (A — r)(l — 7) > is satisfied. 
We define the function 

/(A) - / ^e-(p+(A--)(i-7)).rf,, _ i. 

"'o {l + as)~ ^ 

and verify that /(O) = —00, f (r -\ — ^ j = +00 and /' > 0. Therefore, there 
exist a unique 

A3e(0,r+^) 

7-1 

such that /(A3) = and such that the integrabihty condition p+(A3— r)(l— 7) > 
is satisfied. 
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4.3 Comparative analysis. 

We want compare the equilibrium strategy with the strategy which, from the 
point of view of the decision-maker at time i = 0, is optimal. We shall do so 
in the case when the interest rate r and the wage w are constant, and when 
u (c) — Inc. 

The equilibrium strategy, as we saw earlier, then is time- independent and 
consists of consuming a constant fraction of current wealth: 

1 r w~\ 

Note that, for the model to be meaningful, wc must have: 

1 



r > 



ir Hs)ds 



otherwise equation H36|) would mean that in equilibrium, consumption is greater 
that income. This makes sense: if the interest on capital is lower than the 
psychological discount rate, there is no point in investing. 

Let us put ourselves in the shoes of the decision-maker at time t — 0, endowed 
with a capital fco, and find the optimal strategy from her point of view. Solving 
the optimal control problem: 

/>oo 

max / h (t) In c (t) dt 
Jo 

— — rk + w — c, k{0) = ko 

we find, by the Euler-Lagrange equation: 

1 dc h' (t) 

cdt h (t) 

which we integrate, to get: 

c(t) = co/i(i)e''* 

Substituting into the dynamics, we get: 
dk 



^ ^ rk + w - coh (t) e''* 
dt 



which we integrate, to get: 



w l\ , . , \ rt w 



kit) — [k^ A Co / h{s)ds\ e 

\ r Jo J r 

Because of the trans versality condition at infinity, wc must have: 
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and the optimal propensity to consume at time t is: 
c (i) _ coh (t) 



X{t) 



h{t) 
H-jlh{s)ds 



h{t)\ h [s) ds 



At time i = 0, we find A (0) = (/„ h (s) ds) . This is precisely the equi- 
librium value, as defined by (|^ . The optimal propensity to consume, A (i), is 
time-dependent, and deviates from the equilibrium value A(0). Note that: 

V(0)^ ,00,^, ,, (h'iO) 



J^h{s)ds \ J^h{s)ds) 

so that A (i) may be greater or smaller than the equilibrium value, according 
to the characteristics of the discount function h. Applying the optimal strat- 
egy (from the point of view of time 0) yields the following dynamic (we set 
/„ h (s) ds = H for the sake of convenience) :: 

fc(i)=(fco + ^-(fco + ^)^j|^(.)d.)e--^ 

c (i) = co/i {t) e-* = 1 (fco + ^) /i (i) e'-* 
Applying the equilibrium strategy yields the following dynamics: 

k [t] = fcoe('-i/^)* + w^—^I^ f 1 - e^--''"A 
r — 1/ H \ I 

Note, however, a remarkable fact. Define the naive strategy as follows: every 
decision-maker acts as if she could commit her successors; she computes the 
control c{s) which is optimal on the interval [i, 00], and consumes c{t). From 
the previous analysis it follows that the naive strategy is an equilibrium strategy. 
This, of course, is particular to the logarithmic case u (c) — Inc. 

5 Indeterminacy in the Ramsey growth problem 

We now go back to the general problem Q, Q in the stationary case, where 
the production function is given by: 

f{t,k)^f{k) 

We then interpret the problem as the Ramsey problem in growth theory. It 
is well-known, and described for instance in the textbook by Barro and Sala-i- 
Martin [S], that there are two versions to that problem: 
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1. The centralized version. A benevolent planner, seeking to maximize the 
integral Q which measures global welfare, determines an optimal growth 
strategy a {t, k) and commits citizens to consume a (i, k) and to invest the 
remainder 

2. The decentralized version. Future interest rates ri (i) and future wages 
wi (t) are common knowledge. The representative individual then solves 
the consumption-saving problem, taking ri (t) and wi (t) as given. This 
determines the rate of investment at any time t. This is turn determines 
the wages W2 (t) that the production sector can offer, and the capital rental 
interest r2 {t). One wants ri = r2 and wi = W2. 

In the case of exponential discount, h{t) = e"''*, both problems have the 
same solution (see 0): if cr (t, k) is a solution of the centralized problem, and 
k (t) the corresponding optimal trajectory, then wi (t) :— f (k) — k (t) /' {k (i)) 
and ri (t) := f (fc) have the property that ri = r2 and wi — W2. 

These notions naturally extend to more general discount functions. In the 
absence of commitment technology, one must replace optimal policies by equilib- 
rium policies, and one is naturally led to two notions of and equilibrium growth 
policy: 

1. The centralized version. There is a succession of benevolent planners, 
each of them holding power during an infinitesimal period of time, and 
having the ability to commit their contemporaries in the consumption 
and production sectors during that period. They agree on an equilibrium 
strategy a {t, k) for the problem Q, Q. 

2. The decentralized version. Future interest rates ri (i) and future wages 
vui (i) are common knowledge. There is a succession of representative in- 
dividuals, and they agree on an equilibrium strategy for the consumption- 
saving problem (|24|l . (|25l) . taking ri (i) and Wi (t) as given. This deter- 
mines the rate of investment at any time t. This is turn determines the 
wages W2 (t) that the production sector can offer, and the capital rental 
interest r2 (t). One wants ri = r2 and wi ~ W2. 

In continuity with the results for the exponential discount, one would natu- 
rally expect that the two problems coincide, but this is no longer the case. 

The results in Barro [5] pertain to the second problem. To the best of our 
knowledge the first one, that is, the study of the planner's problem in optimal 
growth theory under time inconsistency, has not been studied. The remainder 
of this paper is devoted to shedding some light on that problem. As in classical 
growth theory, we will concentrate on the onc-dimcnsional case: d — 1 . 

Definition 8 Take a point k. We shall say that k is an equilibrium point if 
there is a stationary equilibrium strategy cr(fc), defined on a neighbourhood Q 
of k in R'^, and such that all trajectories of fJ5^) starting inside il when t = 
converge to k when t — > cx). 
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It follows from the definition that the trajectory starting from k is k itself: 
the solution of (|13|l with fc (0) = fc is fc (i) = k for all t. Denoting by c the 
consumption along that trajectory, we must have: 

c = /(fc) 

Theorem 9 Assume that k is an equilibrium point, and that the corresponding 
value function V {k) is C^ in a neighbourhood ofk. Then the number a defined 
by: 

_ V" (fc) 

must satisfy: 

a>f'{k)>0 (38) 

If a > f (k), then: 

/"OO 

a h {t) exp [{f (k) ~ a) t] dt ^ 1 (39) 

Jq 

The proof is given in Appendix IDl 
Corollary 10 Set h(t) — e^''*. Assume that k is an equilibrium point. Then: 

f (fc) - P (40) 

and. 






1 + ^/1 + 4^^^^ 



> /'(fc) (41) 



In the exponential case equation H39|l degenerates: it sets no condition on a, 
but determines k through (|4U|I . This is the well-known relation for the optimal 
growth path, which usually is obtained by the transversality condition at infinity, 
and which here is derived in a novel way. 

In the general case, as we will see in the following example, equation H39|l 
does not determine k: it determines a as a function of k. The proof is given in 
the appendix. 

Proposition 11 Set h (t) = e"''* on [0, T], and h(t) = for t > T. Assume 
that k is an equilibrium point. Then, there exists a decreasing function ip : 

]0, oo[-^]0, oo[, with: 

if (a) — > oo when a — > 
<^(1) = 1 

and a number a (T) < l/T such that conditions iV.9|) . iSS\) are equivalent to the 
following: 

< /' (fc) - r < l/T (42) 

aT = ^{[f'{k)-r]T) (43) 



23 



In other words, there is a continuous family of solutions to equation H39|l . one 
for each k such that /' (k) falls in the interval {p, p+ l/T). The corresponding 
a (k) goes to oo when /' (fc) -^ p and to l/T when /' (fc) -^ p + l/T. Note 
that there is no solution for /' (fc) < p oi f (fc) > p + l/T 

For future reference, we write a few properties of the function (p. They follow 
easily from the properties of the function xe^^ : 

Xi < X2 => f (Xi) < If (X2) 

(p (x) — > 00 when x — > 00, 
if (x) — > when a; — > co 
xip (x) ~ ip {xe^'^) with ijj (0) = 0, ij/ (0) — 1, when x > 1 

We now want to know what happens when the horizon T goes to (instant 
gratification) or 00 (exponential discount). Let {a{T),k{T)) be a solution of 
equation l|S^ with h (t) as above: 



a (T) / e""* exp [(/' (fc (T)) - a (T)) t]dt = l 



(44) 



• Let T -> 00. Assume k (T) 



• Let T ^ 0. Assume k (T) 



-> fc and a (T) 
/'(fc)=P 
fc and a (T) - 
k = 



a > 0. Then: 



> 0. Then: 



The proof of the first part follows immediately from the estimate < 
/' (fc (T)) -p< l/T. For the second, we have a (T) = 93 (/' (fc (T)) T - pT) /T. 
Since the left-hand side converges, so must the right-hand side, so ip (/' {k (T)) T - 
must go to infinity when T —^ 0, which is only possible if /' (fc (T)) -^ 00. Since 
/ satisfies the Inada conditions, we must have k (T) -^ 0, as announced. 

These results are conform to economic intuition. Note in particular that, 
when T — > 00, we find again the condition /' (k) — p in. the limit. However, for 
finite T, equation H39|) does not determine k (T), which is a striking difference 
with T = 00. In this, as in the general case of non-constant discount, we 
have been unable to find any further condition that would determine k(T). 
This would indicate non-uniqueness of possible k{T), and hence a multiplicity 
of equilibrium strategies, one for each possible value of k (T) and a (T). The 
following results, which are valid in the case of general non-constant discounts, 
indicates that, even with non-uniqueness, there is a definite range of possible 
equilibrium values for k. 

Corollary 12 Assume that the discount function h (t) satisfies: 

e-P^* <h{t) < e-P^* fort>0 

for some < pi < p2, and that k is an equilibrium point for h. Then: 

Pi < f (k) < P2 



pT) 
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Proof. From equation (|39|1 . we have: 

/•OO 

1 = a / h{t) exp [(/' (k) - a) t] dt (45) 

Jo 

/"OO 

<a/ exp[(-ri +/'(fc) -a)i] di (46) 

Jo 



a 



ri - /' ik) + a 



(47) 



and this gives /' (k) > ri . Hence the result ■ 
More generally, we have the following result: 

Proposition 13 Assume that the discount functions hi and h satisfy: 

ho {t) < hi (t) fort>0 

Denote by Kq and Ki the set of equilibrium points for hg and hi respectively. 
Then: 

sup Kq < sup Ki 

Proof. Assume otherwise, so that there exists some Jsq G Kq such that fco > 
sup Ki . Then there exists some ki ^ Ki with fci < fcg • • Since / is strictly 
concave, we must have /' (fco) < /' (^i)- Set: 



^o{a)-=a ho{t)exp[{f'{ko)-a)t]dt (48) 

Jo 

/•OO 

(pi{a):^a hi {t) exp [{f {h) - a) t] dt (49) 

Jo 

Since fci ^ Ki, we have tpi (a) ^ 1 for all a > 0. Since (pi (a) — > when 
a —> OO, this implies that ipi (a) < 1 for all a > 0. Since ho < hi and 
/' (ko) < /' (^i): we have ipo < (fii, such that ipi {a) < 1 for all a > 0. ■ 

6 Conclusion 

This paper tried to model the idea that the decision-maker at time t cannot com- 
mit her successors by imagining that she can commit her immediate successors, 
those in the interval [t, t + e], and letting e — > 0. We then gave a rigourous def- 
inition of (subgame perfect) equilibrium strategies, characterize them through 
the equations (IE) and (DE). We give a local existence result in the analytic 
case. 

One would, of course, like to have a global existence result, on R'^ x [0, T], 
and to have weaker regularity assumptions (sufhciently differentiablc instead 
of analytic). Unfortunately, proving such a theorem presents us with some 
serious mathematical challenges, and much more work is required before we 
understand the situation. In fact, it seems to be very similar to the situation 
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wich prevailed on the (HJB) equation itself before the discovery of viscosity 
solutions by Mike Crandall and Pierre-Louis Lions when issues of existence, 
uniqueness and regularity where intertwined in a very unsatisfactory manner. 
We feel that a similar program has to be undertaken for equation (DE). 

Another question is: why the continuous time ? Would it not be easier to 
work with discrete time, and actually get the continous case by an appropriate 
limiting process from the discrete case ? The answer, as we pointed out in the 
introduction, is that we have no existence result for subgame perfect equilib- 
rium in the discrete case, so it is by no means clear that it is easier than the 
continuous case. When Aumann started the study of economies with a contin- 
uum of consumers, theorems were first proved directly, and the connection with 
economies with a large number of consumers came much later. For instance, the 
fact that if one constructs an economy with Nn agents by replicating TV times an 
economy with n agents, the core of the large economy converges to the equilibria 
of the limiting economy (which has a continuum of agents) was first proved by 
Herbert Scarf, and was hailed as a major achievement. Here again, such limiting 
results may hold for equilibrium strategies, but it is another research program. 

Finally, the obvious economic question is whether equilibrium strategies are 
observationally different from optimal strategies. The difficulty here is that, 
although the equilibrium strategy is defined for all (i, fc), we only observe one 
trajectory of the dynamics, the one that starts at /cq st time t — Q. Devising 
testable consequences for our model will be a third research program. 

A Proof of Theorem [2]: 

A.l Preliminaries 

Before proceeding with the proof of the theorem, let us mention some facts 
about the flow K, defined by ^^ , ^^ . 

Note first that the solution of (|14|l which takes the value k at time t coincides 
with the solution of the same equation which takes the value K. (si, t, k) at time 
si. In mathematical terms, this property may be stated as 

IC (s2, t,k) ~ IC (s2, si,IC{si,t,k)) , < t < si < S2 < T. (50) 

Next, consider the linearized equation around a prescribed solution t ^ ko (t) 
of the nonlinear system (|16|) . namely: 

This is a linear equation, so the fiow is linear. The value at time s of 
the solution which takes the value k at time t is TZ{s,t)k, where the matrix 
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n{-,t) : [t,T] — > R^""^ satisfies: 

^(^, t) = (|{ (^, fco (s)) - % is, fco Gs))) 7^ (., t) (52) 

7^ (t, t) = I (53) 

From standard theory, it is well known that, if / and a are C*^, then IC is 
C"="i, and: 

dK{s,t,k) ^, , 
9/C(s,i,A:) 



9t 



-7^(i,s)(/(t,fc)-a(f,A:)) 



where 7?.(i, s) is computed by setting fco (s) = /C (s, t, fc) in formulas if^ . l|^ . 
Let us now turn to the actual proof of Theorem |21 

A. 2 Necessary condition 

Given an equilibrium strategy ct, define a function V by: 

V{t,k)= I h{s-t)u{a{s,IC{s,t,k)))ds + h{T-t)g{K:{T,t,k)), (54) 



Differentiating with respect to fc, we find that: 
— {t,k)^ / Hs -t)—{a{s,IC{s,t,k))) — {s,IC{s,t,k)) — {s,t,k)ds 
+ h{T-t)^{IC(T,t,k))^{T,t,k) 

h{s-t)-^{ais,ICis,t,k)))-£{s,IC{s,t,k))n{s,t)ds 
+ h{T -t)^{IC{T,t,k))TZ{T,t) 

The (IE) equation will be derived by maximizing the individual payoff Pi (t, k,a,c), 
as in formula (|10|l . To this end, let us first notice that the function fci defined 
by (|ll|l and p2l) can be written as 

fci(s) ==7^(s,t)(c^(t, fc) -c), 

so that the individual payoff becomes 

Pi (i, fc, a,c) ~ u (c) — M ((T(t, fc)) 

/i [s -i)-£i'^ (S' ^0 (s))) -£ (s, fco (s)) 7^ (s, t) (a(i, fc) - c) ds 
+ /i (r - i) ll (fco (T)) 7e(T, t) (a(t, fc) - c) 
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Since u is concave and difFerentiable, the necessary and sufficient condition 
to maximize Pi(t, fc, a, c) with respect to c is 

^^ic)=J h{s-t)^{a{s,IC{s,t,k)))^{s,IC{s,t,k))n{s,t)ds 
+ HT~t)^{IC{T,t,k))n{T,t)^^{t,k). 

Therefore, the equiUbrium strategy must satisfy 

du , , , , , dV , , , 
-(a(.,fc)) = -(t,fc) 

and, substituting back into equation (|54|) . gives the (IE) equation. 

A. 3 Sufficient condition 

Assume now that there exists a function V satisfying (IE) and (BC), and con- 
sider the strategy o — io ^. Given any consumption choice c <^ R'^, the payoff 
to the decision-maker at time t is: 

Pi (i, fc, a,c) = u (c) — u {a{t, k)) 

h{s-t) — {a (s, fco (s))) — (s, /co (s)) 7^(s, t)ds 



+h{T-t)^{ko(T))TZ{T,t) 



{a (t, k) ~ c) 



dV 

= u{c)~u {ait, k)) + — (i, k) {a (i, k) ~ c) 

Qu 

= u{c^-u {ait, k)) --g^i'J {t, k)) {c-a (t, fc)) 

<0, 

where the first equality follows from the definition of TZ, the second equality is 
obtained by differentiating V with respect to k, the third equality follows from 
the definition of a, and the last inequality is due to the concavity of u. Observing 
that Pi{t,k,a,a {t,k)) = 0, we see that the inequality Pi{t,k,a,c) < proves 
that c — a {t, k) achieves the maximum so that a is an equilibrium strategy. 
Q.E.D. 

B Proof of Proposition [31 

Let a function V : [0, T] x R''- ^ R'^ be given. Consider the function: 
ip {t, k)^V (t, k)- I h{s - t)u {a{s, /C (s, t, k))) ds - h{T - t)g (/C (T, t, k)) 
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where a — i o ^. 

Consider the value of ip along the trajectory of (|13|l originating from k at 
time t. It is given by: 

ip (s, t,k) = ip (s, /C (s, t, k)) 
= V{s,]C{s,t,k)) 

i-T 

h{x — s)u {a{x, K, {x, s, K- (s, t, k)))) dx 

h{T-s)g{JC[T,s,JC[s,t,k))) 
V{s,JC{s,t,k)) 

T 

h{x — s)u {(j{x^ K, [x, t, k))) dx 



-h(T-s)g{}C{TXk)) 

where we have used formula H50() . 

We compute the derivative of this function with respect to s: 

dil) dV dV 

— (s, k,t)^ — (s, /C (s, t, k)) + — {s,IC {s, t, k)) (/ (s, /C (s, t, k)) ~a{s,K: (s, t, k))) 

+ / h'{x — s)u{a{x,IC{x,t,k))) ds + u{a{s,]C{s,t,k)) 



+ h'{T-s)g{JC{T,t,k)) 
Since a = i o ^, we have: 

dV f dV 

-— (s, /C (s, t, k)) a (s, K. (s, t, k)) + u (ct(s, K. (s, t, fc)) = w ( — (s, /C (s, t, k)) 

Substituting in the above, we get: 

djp dV dV 

-g- {s, k,t)^ — (s, /C (s, t, k)) + -Q^i^il^ («> *> fc)) / (s> ^ («> ^> ^)) 

/'X' / It/ 

+ / ft,'(a; — s)m (cr(x,/C (x, t, fc))) ds + u — — (s, /C (s, t. fc)) 
Js \dk 

+ h'iT^s)g{]C{T,t,k)) 

If (DE) holds, then ip{s,k,t) = il;{T,k,t), and if (BC) holds, then V is 
identically zero, so that (IE) holds. Conversely, if (IE) holds, then (BC) and 
(DE) obviously hold. Q.E.D. 

C Proof of Proposition El 

Define the function 

Mis, t, k) = JC{s, t, /,)e-//('-(»)-^("))'i" 
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with the understanding that the flow /C is associated to the strategy (|3UII . Then 
we have 



ds J^ 

and after integrating this equation on [t, s] we get 

M{s,t,k) = k+ f e-''"(''(^)-^(^»'^^w(u)dw 



X{u)e 



-f^^'{r{x)~\{x))dx 



-,— [^ r{x)dx 



w{v)dv 



du. (55) 



The last term of this equaHty may be transformed into 



Afule"-'^"'^'"^'^''"^'-'^'^''^ 



X{u)e 



/" X{x)dx 



e-IX^)d^w{v)dv 
i:r(=^)d^w{v)dv^ 



du 

e-i:^(^)d^w{v)dv 



du 



e-.i:'^i^)d^w{u)du 
t 

oc 

e~SX^)d=^w{u)du 

e-.l:'^i^)d^wl^u)du 



\{u)e-^^ ^(^)^^du 



e/t° Kx)dx _ ^ 

g// Kx)dx _ j^ 






e--^t''^^)d^w{v)dv 
A(M)e^" ^'^)''^dw dw 



du 



= - /r r{x)dx 



w{u)du 



J/ A(2:)dx _ 2 _ e.A° Mx)dx I g- Jj" ''(^)''^i(;(-u)d' 



+ / e-''"(''(^)-^(^»''^w(M)di 



where the third equahty follows from Fubini Theorem. Substituting this formu- 
lation in equation H55|l yields 



M(s,t,k) = k+ I e~ ■''" '■(^)'^^u;(w)du - e^*° ^(=")''^ 
and therefore, 



e- f:' ^(.^)d^u!{u)du 

. - 



/C(s,t,A:) = e^'°(''(^)-^(^»''^ 



fc + 



'/"'■(^)rf^u;(w)du 



'/;'-(^)rf^U;(u)rfu. 



Denoting by ^(t, k) the utility associated to the strategy a defined by (|30|) . 
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we see that 



Vit,k) 



1-7 



[a{s,IC{s,t,k))] 
1-7 



h{s — t)ds 

1-7 



1-7 



fc+ e-/r^(^)-.(.)d. 



1-7 



h{s — t)ds 



1-7 



and that, 



1-7 



k+ e-^^^^^)<i^w{u)d^. 



X[s)e^:i'^i^)->-i^))d^ /i(s - t)ds 



1-7 



7 /-oo 



X^s)e^:(r(x)-x(x))dx h{s-t)ds. 



1-7 



Now, since the recursion (|29|l is satisfied, we see that 



dV_ 
'dk 



{t,k) 



k+ I e 



h^'-(='')'^'-'w{u)du 



[xit)r = ia{t,k)y 



Therefore, the integrated equation l|2()|) is satisfied which in turn estabhshes that 
the strategy a defined by (|30() is an cquihbrium strategy for the non-stationary 
problem ^^,^^ . 

D Proof of Theorem [HI 

Proof. Write equation (DE) for the function V {k): 

u {V) + fV + h' (t) u (c [t)) dt = 

Jo 

with c{t) = a (/C (t, fc)) = i {V (/C (t, k))). 

Differentiate it at the equihbriuni point fc. We get: 

{u' {v (fc)) + / (fc)) V" {k)+r (fc) r {k)+j^ h! it) u' ic)) z' {v (fc)) V" (fc) ^^^di 

(56) 
We have v! {V' (fc)) = —i {V' (fc)) — — c, so that the first term vanishes. 
We are left with the two others. Note first that i' (c) = — u" (c) = — 1/u" (c), 
so that the last integral can be rewritten as follows: 

The function y [t) — dK. {t, fc) /dk is the solution of the linearized system at 
h 

I = (/' (fc) - z' {V (fc)) V" (fc)) y = (/' (fc) - a) y (57) 
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Since k is an attractor, the exponent (/' (fc) — aj must be non-positive, so 
/' (fc) — a < 0, which is condition H38I) . 

From now on, we assume /' (fc) — a < , so that the hnearized equation H57|l 
converges, and we have: 

^^=exp[(/'(fc)-a)t] 

This gives us the last term in H56|l . We now compute the middle term by 
differentiating the formula for V : 

/>OC 

V{k)^ / h{t)u{c{t))dt 
Jo 

yielding, by the same computation: 



Substituting in equation IjSGII . we get 
u'ic) 



-y" {k) 



f (fc) / h (i) exp [(/' (fc) -a)t]dt+ / h' (t) exp [(/' (fc) - a) t] dt 



u" (c) 
and hence: 

/o'"/i'(i)exp[(/'(fc)-a)t]di 



= 



/' (fc) - 



J^hit)ej,p[{f'{k)^a)t]dt 
(f (k) - a) /q°° h jt) exp [{f (k) ^a)t]dt+l 
/o°"/i(i)exp[(/'(fc)-a)t]di 



where we have integrated by parts. This in turn gives formula H39|l and concludes 
the proof. ■ 

E Proof of Corollary M 

Substitute into equation (|^ . We get for a the equation. 

/•OO 

1 = a / exp [-P + f (fc) -a]dt = — 

If /' (k) ^ p, there is no solution to this equation, so /' (fc) must be equal 
to p. In order to establish H41|l . we differentiate twice the (DE) equation (which 
is here the HJB equation) and evaluate it at k and get 

^V'ik)f"Ck) = u"{c)a {f'ik) - a) . 
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This is a quadratic equation in a and, assuming / is concave, it admits two 
roots, 



= fCk) 



p-^u" [k) 



The second root is not vaUd because k is an attractor and hence < /'(fc) < a. 
This leave us with the only possible root a given by l(^ . Q.E.D. 

F Proof of Proposition 1111 

Substituting the specification of the discount function into equation l(^ gives 

l^a [ exp [{-p + f (k) - a) t] dt (58) 

Since a > f {k), the term p ~ f (k) + a is different from and therefore 
the equation lf55|) becomes 

(/' (k) - p) Texp [-T (/' (k) -p)]^ aTexp {-aT) (59) 

The left inequality of (|42|l is simply obtained by noticing that, due to 
equation (|58|) . a must be positive and the equation H59|) implies then that 

/' {k)~P> 0. 

Now notice that equation (|59|) is of the type xe^ = ye** . It has the obvious 
solution X ^ y, plus another one. The first solution gives /' (fc) — p = a, 
contradicting the fact that p — f (k) + a ^ 0, so it must be rejected. The 
second solution defines y as a function of x, say y = ip (x) for a; > 0, which 
is easily seen to be decreasing and to obey the properties given in (??). So 
aT ^ip{T (/' (k) - p)) , and formula lO follows. 

Now, taking into account the condition a > f (fc) given by 138(1 . equation 
l(^ implies 

^ (/' (k) T-pT)> r (fc) T>f{k)T^ pT. 

Since the function ip is decreasing and >p{l) — 1, the above inequality implies 

/' {k)T-pT<l 
which is precisely the right inequality of of (|42|l . 
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